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7.2 DIVIDE-AND-CONQUER RELATIONS 

In this section we present a special class of recurrence relations that arise frequently in 
the analysis of recursive computer algorithms. These are algorithms that use a “divide- 
and-conquer” approach to recursively split a problem into two subproblems of half the 
size. The dictionary search in Example 3 of Section 3.1 is such an algorithm. A binary 
tree is explicitly or implicitly associated with most “divide-and-conquer” algorithms. 
Conversely, many counting problems involving trees (the subject of Chapter 3) are 
most easily solved with divide-and-conquer recurrence relations. 

The total number of steps a n required by a divide-and-conquer algorithm to 
process an n-element problem frequently satisfies a recurrence relation of the form 

a n = ca n/2 + f{n) (1) 

The following table indicates the form of the solution of (1) for some common values 
of c and f(n) (|>] denotes the smallest integer m with m > r): 


c 

f(n) 


c = 1 

d 

d\\og 2 n) + A 

c = 2 

d 

An — d 

c > 2 

dn 

A,,‘«. + ( 2 _ c )„ 

c = 2 

dn 

dn(|"log 2 n] + A) 


The constant A is to be chosen to fit the initial condition. 

If a problem is recursively split into k parts instead of two parts, then one should 
replace 2 by k everywhere in the foregoing table, except the solution for c — k and 
fin) = cl becomes An — d/(k — 1). For example, the recurrence relation 


a n =ca n /k + dti c=fk 

has the solution 

a n =An'°* c +(-^)n (2) 

The solutions for a n given in the foregoing table are easily verified by substitution. 
Consider the case a„ — ca n /2 + dn, c >2. Substituting the table’s solution of a„ = 
An XoglC + [2d/(2 — c)]/7 into ca „/2 + dn, we have 


ca n /2 + dn = c 


/ n \ Io § 2 c 

A k) 


cA« log2C cdn 
■ + 


2d ^ n 

l^c) 2 

(2 — c)dn 


■ dn 


2 log 2 c ' 2-c ' 2 — c 

cAn log2C cdn + (2 — c)dn 


= An'° S2C + 


2 d 
2-c 
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The following examples illustrate such “divide-and-conquer” recurrences and 
their solution. 

Example 1: Rounds in a Tournament 

In a tennis tournament, each entrant plays a match in the first round. Next, all winners 
from the first round play a second-round match. Winners continue to move on to the 
next round, until finally only one player is left—the tournament winner. Assuming that 
tournaments always involve n = 2 k players, for some k, find and solve a recurrence 
relation for the number of rounds in a tournament of n players. 

In terms of binary trees, a n is the height of a balanced binary tree with n = 2 k 
leaves. Since half the players are eliminated in each round, the number of rounds 
increases by 1 when the number of players doubles. The recurrence relation for a„, 
the number of rounds, is thus 

G n = 6E«/2 + 1 

From the foregoing table, the solution of this recurrence relation is a„ = log 2 n + A. 
To determine A, we observe that 0 = a\ = log 2 1 + A = 0 + A, and so A = 0. ■ 

Example 2: Finding the Largest and Smallest Numbers in a Set 

Build a recurrence relation model to count the number of comparisons that must be 
made in the following algorithm for finding the largest number / and the smallest 
number s' in a set S of n distinct integers. Then solve this recurrence relation. 

Initially suppose that n is an even number. Assume that we have already found 
/i and ,V|, the largest and smallest numbers, respectively, in the first half of S (the 
first n/2 numbers) and have found / 2 and s 2 , the largest and smallest numbers in the 
second half of S. Then make two comparisons, one between /1 and / 2 and the other 
between ,V| and s 2 ,to find the largest number l and smallest number s in S. 

The associated recurrence relation for the number of comparisons in this proce¬ 
dure is a n = 2a n/2 + 2, for n > 4 and even. If n is odd and we split S almost equally, 
the relation would be ci n = fl(„+i )/2 + o.(n-i )/2 + 2. Observe that ct\ = 0, since the one 
number is both largest and smallest. And a 2 = 1, since we can determine the larger 
and smaller number in a two-element set with one comparison. With these two rela¬ 
tions along with a\ and « 2 , we can recursively determine the number of comparisons 
needed for any n. 

Next we solve the recurrence relation a n — 2a n /2 + 2, n > 4, with a 2 = I. The 
foregoing table tells us that the solution will be of the form a n = An — 2. We confirm 
this by substituting a„ = An — 2 into both sides of the relation a n — 2a n /2 + 2: 

An — 2 = a„ = 2a n /2 + 2 = 2(A — — 2) + 2 

= An — 4 + 2 = An — 2 

We can use the initial condition a 2 = 1 to determine A: 


3 

1 = o 2 = A!(2) — 2 or Ai = — 
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So a n = — 2 is the number of comparisons needed to find the largest and 

smallest number according to the procedure given previously. (It is possible to prove 
that one cannot do better than \n — 2 comparisons.) ■ 


Example 3: Efficient Multidigit Multiplication 

Normally one must do n 2 digit-times-digit multiplications to multiply two n-digit 
numbers. Use a divide-and-conquer approach to develop a faster algorithm. 

Let us initially assume that n is a power of 2. Let the two n-digit numbers be g 
and h. We split each of these numbers into two n/2-digit parts: 

g = gl 10 n/2 + g 2 /? = /7 1 10" /2 + /z 2 


Then 


g x h = (gi x /ii)10" + (g! xh 2 + g 2 x h 1 )10 n/2 + g 2 x h 2 (3) 

Observe that 


g\xh 2 + g 2 x /?! = (gi+g 2 ) x (/?! +h 2 )-g l X hi -g 2 x h 2 

and so we need to make only three n/2-digit multiplications, g i x h\, g 2 x h 2 . and 
(g t + g 2 ) x (hi + h 2 ) to determine g x h in (3) (actually (gi + g 2 )or(/?i + h 2 ) maybe 
(n/2 + l)-digit numbers, but this slight variation does not affect the general magnitude 
of our solution). If a n represents the number of digit-times-digit multiplications needed 
to multiply two n-digit numbers by the foregoing procedure, then the procedure yields 
the recurrence a n — 3 a„/ 2 . 

By the table at the start of this section (where d — 0), a„ is proportional to 
w t°g 2 3 _ n i.6 a substantial improvement over n 2 . ■ 


In some settings, we are not so interested in an exact formula for a„ as we are 
in the general rate of growth for a„. The following theorem from Cormen, Leiserson, 
and Rivest [2] gives bounds on such growth. 

Theorem 

Let a„ = ca n /k + f(n) be a recurrence relation with positive constant c and the positive 
function f(n). 

(a) If for large n, f(n) grows proportional to « log * e [that is, there are positive 
constants p and p' such that pn u,gt r < f(n) < p'n k ' gt ' ], then a n grows proportional 
to 77 logtf log 2 c. 

(b) If for large n, f(n ) < pn q , where p is a positive constant and q < log /( c, 
then a„ grows at most at a rate proportional to « logi c . 
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1.2 EXERCISES 


1. Solve the following recurrence relations assuming that n is a power of 2 (leaving 
a constant A to be determined): 


(a) 


— 2 

+ 5 

(b) 

u n 

— 2 £Z ;1 /4 

+ n 

(c) 

a n 

= a„i 2 + 2n- 1 

(d) 

a n 

— 3*2 n /3 

+4 

(e) 

a n 

= 16a„/2 + 5n 

(f) 

G n 

= 4n„/2 

+ 3 n 


2. Find and solve a recurrence relation for the number of matches played in a 
tournament with n players, where n is a power of 2 . 

3. In a large corporation with n salespeople, every 10 salespeople report to a local 
manager, every 10 local managers report to a district manager, and so forth 
until finally 10 vice-presidents report to the linn’s president. If the him has n 
salespeople, where n is a power of 10 , find and solve recurrence relations for 

(a) The number of different managerial levels in the firm 

(b) The number of managers (up through president) in the firm 

4. In a tennis tournament, each player wins k hundreds of dollars, where k is the 
number of people in the subtournament won by the player (the subsection of the 
tournament including the player, the player’s victims, and their victims, and so 
forth; a player who loses in the first round gets $100). If the tournament has n 
contestants, where n is a power of 2 , find and solve a recurrence relation for the 
total prize money in the tournament. 

5. Consider the following method for rearranging the n distinct numbers 
x\, X 2 ,..., x„ in order of increasing size (n is a power of 2). Pair the integers off 
{xi, X 2 1. {x 3 , X 4 }, and so forth. Compare each pair and put the smaller number 
first. Next pair off the pairs into sets of four numbers and merge the ordered pairs 
to get ordered 4-tuples. Continue this process until the whole set is ordered. Find 
and solve a recurrence relation for the total number of comparisons required to 
rearrange n distinct numbers. {Hint: First find the number of comparisons needed 
to merge two ordered A'-tuples into an ordered 2A:-tuple). 

6 . In a standard elimination tournament, a player wins $ 100A: when he/she wins a 
match in the Mi round (e.g., first round win earns $ 100 , second round win $ 200 ). 
Develop and solve a recurrence relation for a n , the total amount of money given 
away in a tournament with n entrants, where n is assumed to be a power of 2 . 

7. Verify by substitution the form of solution given in the text to the following 
recurrence relations: 

(a) a„ =a„/ 2 + d 
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(b) a n = 2 a n /2 + d 

(c) a„ = 2 a n /2 + dn 

8 . (a) Use a divide-and-conquer approach to devise a procedure to find the largest 

and next-to-largest numbers in a set of n distinct integers. 

(b) Give a recurrence relation for the number of comparisons performed by your 
procedure. 

(c) Solve the recurrence relation obtained in part (b). 

9. (a) Use a divide-and-conquer approach to devise a procedure to find the largest 

number in a set of n distinct integers. 

(b) Give a recurrence relation for the number of comparisons performed by your 


procedure. 

(c) Solve the recurrence relation obtained in part (b). 



7.3 SOLUTION OF LINEAR 

RECURRENCE RELATIONS 

In this section we show how to solve recurrence relations of the form 

a n = C\a n -\ + c 2 a n _ 2 + • • • + c r a, ,_ r (1) 

where the c, s are given constants. There is a simple technique for solving such rela¬ 
tions. Readers who have studied linear differential equations with constant coefficients 
will see a great similarity between their solution and the form of solutions we discuss 
here. The general solution to (1) will involve a sum of individual solutions of the form 
a n — a". To determine what a is, we simply substitute a k for a* in (1), yielding 

a" = Cia" -1 + c 2 a n ~ 2 H-f c r a n ~ r (2) 

We can reduce the power of a in all terms in (2) by dividing both sides by a"~ r : 

a 1 ' = Cia r ~ l + c 2 u'~ 2 H-h c r (3) 

or, equivalently, 

a' — c\a r ~ l — c 2 a r ~ 2 - c r — 0 (4) 

Equation (4) is called the characteristic equation of the recurrence relation (1). 
It has r roots, some of which may be complex (but we shall initially assume that there 
are no multiple roots). 

If aq, ot 2 , .. ., a, are the r roots of (4), then, for any i, 0 < i < r, a„ = a" is a 
solution to the recurrence relation (1). It is easy to check that any linear combination 
of such solutions is also a solution (Exercise 8). That is, 

a n — A ] ry^ T A 2 (i\ + •••-{- A t a" 
is a solution to (1), for any choice of constants A,-, 1 < i < r. 


( 5 ) 



